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I. INTRODUCTION 





As the costs of health care continue to spiral ever upward, Pecans 
“h an’ 
the public has begun to ask questions, and through its elected : eee 


representatives, demand answers, about health care in the 
United States. This has been particularly true in the public 
sector, including the uniformed military services, where health 
care is financed through collection of taxes and creation of 
public debt. 

The public is beginning to demand accountability for 
government's use of budgetary assets. The who, what, when, 
where, and how of publicly financed health care services is 
being questioned at virtually every level of government. 

The answers to many of these questions have been legislated ‘+ 
through our system of laws and regulations. [Ref. 1-2] Others 
come from currently accepted professional practices, current 
technology, and the availability of resources. Some seem to 
have no generally accepted answers, a fact that is a bother- 
some and multifaceted problem in itself. 

First, because of the highly qualitative and multidimen- 
sional nature of health care, there has been little agreement 
on an operational definition of health. An acceptable 
definition of health would have to reflect social preferences 


toward various functional levels: social, mental, and physical; 


the relative importance of diseases and disabilities; the 
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et 


"e's ahs 


likelihood of occurrence of different diseases and disabili- 


ee 
eft 


ties; and the prognosis associated with each disease and 


# 
re 
. 
a 


le” disability. [Ref. 3] Concurrence, even on these facets, has 
. been difficult to achieve. 

Second, because health is multidimensional, it cannot be 
actually measured, only inferred. Specific components of 
health, once identified, must be defined, measured to the 
extent possible, and relative weights, representing social 
and clinical values, assigned. These separate components of 
health may be considered as individual indicators of health 
and combined to form an index of general health status. Once 
an index of health status has been conceptualized, developed, 
and operationalized, it may be used to indicate relative levels 
of health in both individuals and populations; serve as a 

a measure of the effectiveness of health care systems; and 
i a serve as a single component of individual measures of 
accountability, efficiency, effectiveness, productivity, 
quality, etc. {Ref. 4-6] 

Neither of these two major issues are easily resolved, 


however, and a fair body of literature now exists discussing 





= conceptual and methodological problems inherent in the 


development and use of health status indexes. Two major 





* problems that seem to be pervasive throughout the literature 
are the tendency to conceptualize health in all encompassing 


definitions, making measurement difficult; and the tendency 





to try and develop mathematical formulas and models which 
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will capture all components of health, yet are so complex 
they are rendered unusable for most practitioners and 


managers. [Ref. 7~11] 


re 


These problems, however, have not deterred researchers, 


t 


. a4 


practitioners, and decision makers, particularly within the 
public health sector, from searching for such measures. 

This thesis represents a further attempt to find and 
evaluate a health status index, primarily for oral health, 
for use within the naval health care arena, capable of 
meeting the needs of clinicians, administrators, and public 
decision makers alike. 

The first step in this attempt to find a suitable oral 
health index was an examination of past research and clinical 
practices through a review of relevant literature. This 
r review of pertinent literature provides the substance of the 


following chapter. 
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- II. LITERATURE REVIEW 


As can be seen from the bibliography, there is a wealth 
of literature available pertaining to health indexes. To 
provide some semblance of order in reviewing the literature, 
indexes directed primarily toward general health issues will 
be discussed first, followed by a survey of a wide range of 
indexes pertaining to oral health, a review of a number of 
more popular and widely accepted oral health indexes, and 
an examination of recent developments regarding oral health 


indexes. 


A. GENERAL HEALTH INDEXES 

General health indexes of a wide variety have been 
proposed to measure an individual's social and physical 
well-being [Ref. 12-13]; the overall health status of 
communities and general populations [Ref. 14-17]; implications 
and importance of various social and sociomedical factors in 
health care [Ref. 18-20]; unmet health care needs of individ- 
uals and populations [Ref. 21-22]; society's values and 
utilities of various conditions of life [Ref. 23-24]; quality 
of health care services and outcomes of health care interven- 
tions [Ref. 25-27]; priorities of health care programs in 
society and governmental agencies [Ref. 28]; effectiveness 
of health care programs in achieving desirable health care 


outcomes [Ref. 29-35]; utilization and resource allocation in 
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providing health care services and achieving desired health 
care outcomes [Ref. 36-37]; clinical, technological, social, 
political, and economic indicators for health care policy and 
research [Ref. 38]; clinical, technological, social, political, 
and economic indicators for health care planning [Ref. 39-41]; 
morbidity and mortality [Ref. 42]; patient's preferences in 
obtaining health care services and achieving health care 
outcomes [Ref. 43]; impact of sickness on individuals, groups, 
and populations [Ref. 44-47]; seriousness of illness and its 
consequences, clinical as well as social [Ref. 48-49]; dis- 
ability and its consequences, for individuals as well as 
society [Ref. 50-52]; illness in the aged and its consequences, 
for individuals as well as society [Ref. 53]; and comprehen-~ 
sive health measures indicating specific health states 

(Ref. 54]. 

As can be seen above, a great deal of time and effort has 
been expended in attempts to develop a wide variety of general 
health status indexes. The vast majority of these indexes 
have been developed for special purposes, however, and are 
generally valid only under specific circumstances. None of 
them are universally accepted as general health status indexes, 
nor are they useful under the wide range of conditions and 
situations of interest to public health decision makers. 

This situation is no less problematic within the dental 


health sector, the area of principal concern for this thesis. 
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f B. GENERAL ORAL HEALTH INDEXES Rees 
st As wen indexes developed for evaluating general health Re 
te. states, a vast amount of literature is available regarding Lory 
: the development and utilization of indexes for a variety of ee 
conditions and situations relating to oral health. Ne 
There are general oral health indexes developed for a wide bee 
> range of epidemiological studies to examine the prevalence and 
: incidence of oral disease and the oral health status of 
communities and populations [Ref. 55-60]; social and socio- 
dental factors associated with oral health of individuals and 
= populations, particularly as related to influences of cultural 
and ecological factors [Ref. 61-63]; unmet dental health needs 
of individuals and populations in a variety of social and 
economic situations [Ref. 64-73]; dental health status and 
= Cre general satisfaction with specific dental conditions [Ref. 
- a 74]; outcomes, appropriateness, and quality of oral health 
care services provided [Ref. 75-88]; efficiency and produc- 
tivity of dental health services [Ref. 89-91]; anxiety related 
to dental health care [Ref. 92]; and the needs of special 
populations such as the elderly and the military [Ref. 93-110]. 
2 C. SPECIFIC ORAL HEALTH INDEXES 
* In addition to the general oral health indexes, there 
are a number of more specific oral health indexes that relate 
- primarily to specific oral structures and tissues, clinical aes 
. conditions, and diagnostic methodologies. There are indexes 
developed primarily for measurement of levels of oral hygiene ear 
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[Ref. 111-120]; the amount of soft accumulations, plaques, 

stains, and debris on dental structures [Ref. 121]; the amount a> 
of hard deposits and calculus on dental structures [Ref. 122- 
124]; the clinical condition, relative health, and pathologic 
states of the gingival structures [Ref. 125-135]; the number 
of carious lesions and decayed teeth [Ref. 136-153]; severity, 
incidence, prevalence, and consequences of periodontal disease 
(Ref. 154-199]; the degree of alveolar bone loss secondary to 
periodontal disease, as measured by periodontal pocket depth, 
radiographic analysis, and surgical determination [Ref. 200- 
205]; the assessment of tooth mobility secondary to periodontal 
disease and alveolar bone loss [Ref. 206]; the loss of teeth 
secondary to disease and injury [Ref. 207]; the identification 
and scoring of occlusal disorders [Ref. 208-210]; the identi- 
fication of dental structures potentially requiring endodontic 
intervention [Ref. 211-212]; the identification of need, 
prioritization, and outcomes of orthodontic treatment [Ref. 
213-214]; the use of radiographic methodologies in clinical 
diagnosis, prognosis, and follow-up of oral disease, injury, 
and treatment outcomes [Ref. 215-220]; and the use of complex 
mathematical, statistical, and computerized models to predict, 
evaluate, and monitor the need for clinical services, the 
outcome of dental intervention, and econometric measures of 


productivity [Ref. 221-230]. 
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D. WIDELY KNOWN ORAL HEALTH INDEXES EN : 
ei. A number of these indexes have been generally accepted, mos 
| (e. although often in only very restricted situations, and have oe 
; been used in a wide variety of epidemiological studies: aS 
: l. The DMF Index Ee 
; The DMF (Decayed, Missing, or Filled) index, developed GS 
. by Klein, Palmer, and Knutson, while studying the dental needs Roe 
of elementary school children in Hagerstown, Maryland, during aS 
: the late 1930's, provided the first and perhaps best known and serece 
most widely accepted, of the oral health indexes. [Ref. 231- Sens 
: 234] weeks 
sad 
c The DMF index is based on ascertaining the number of oe 
: teeth which are carious, missing, or restored (filled). The nee 
= index has been reported in at least two different methodolo- eee 
i poor gies. First, the DMF index may be reported as the average a 
“ rie number of DMF teeth per person examined. This is sometimes 
Q referred to as the DMFT (decayed, missing, or filled teeth) 
E index. And, second, the DMF index may be reported as the 
average number of DMF tooth surfaces per person examined. 
e This is sometimes referred to as the DMFS (decayed, missing, ae 
. or filled surfaces) index. [Ref. 235] 
: 2. The PMA Index 
: The PMA (Papillary gingivae, Marginal gingivae, and 
é Attached gingivae) index, developed by Schour and Massler 
: during the late 1940's, represented an attempt to provide a 
: quantitative method of recording inflammatory changes in the Rae 
or 
: gingivae. [Ref. 236-243] TTF 
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The index is obtained by assessing the prevalence and 
severity of gingivitis and assigning numerical scores for 
each of three gingival areas for each tooth examined: the 
papillary gingivae, the marginal gingivae, and the attached 
gingivae. A score is established for each tooth and summed 
to provide a PMA index for an individual's mouth. Scores 
obtained for individuals may be summed and averaged to provide 
an epidemiological index for communities and populations. 
[Ref. 244] 
3. Russell's Periodontal Index 

The periodontal index developed by Russell during the 
1950's represented the first major attempt to provide a measure 
of periodontal disease for epidemiological studies. [Ref. 245- 
248] 

Each tooth examined is evaluated for clinical signs 
of periodontitis, particularly noting the usual progressive 
nature of the disease, inflammation of the gingivae followed 
by periodontal pocket formation and eventual loss of mastica- 
tory function. Each tooth is assigned a numerical score, the 
scores are summed for all teeth examined, and the total score 
is divided by the number of teeth examined. This average 
score represents the average conditions of the periodontal 


tissues and structures within a patient's mouth. (Ref. 249j 


4. Ramfjord's Periodontal Index 
The periodontal index, developed by Ramfjord during 


the late 1950's, represented another attempt to provide a 
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measure of periodontal disease for use in epidemiological 
studies. [Ref. 250~251] 

The index is accomplished by conducting a thorough 
examination of the periodontal status of six teeth, parti- 
cularly noting the condition of the gingivae, periodontal 
pocket depth, calculus and plaque deposits, attrition, 
mobility, and lack of contact. [Ref. 252] 

5. Gingival-Bone Count 

The gingival-bone count, developed by Dunning and 
Leach during the late 1950's, represented another attempt 
to provide a measure of periodontal disease for use in 
epidemiological studies. Of particular interest to the 
developers was the ability of an index to reflect both 
reversible signs of periodontal disease, primarily gingival 
changes, and irreversible sequelae of periodontal disease, 
primarily alveolar bone loss. [Ref. 253] 

The gingival-bone count is obtained by assessing the 
gingival status and bone loss of each tooth examined, a 
numerical score assigned for each tooth by combining the 
individual gingival scores and bone scores, and an average 
computed for the whole mouth. [Ref. 254] 

6. Oral Hygiene Index (OHI) 

The oral hygiene index, developed by Green and 
Vermillion during the late 1950's, and subsequently modified 
to provide the simplified oral hygiene index (OHI-S), repre- 


sented a further attempt to provide a measure of periodontal 
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disease for use in a wide range of epidemiological studies. 
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[Ref. 255-257] 


x * 
The oral hygiene index is actually a combination of a - 


en 


two separate indexes, the debris index and the calculus index. 
The debris index is obtained by evaluating the amount of debris 
on each of six preselected tooth surfaces and assigning a 
numerical score for each tooth. The individual tooth scores 
are summed and the total divided by the number of teeth 
examined. The calculus index is obtained similarly, 
evaluating each of the teeth for the presence of calculus. 

The oral hygiene index is then obtained by summing the debris 


index and the calculus index. [Ref. 258] 


7. Gingival Index, Plaque Index, and Retention Index 
System 


The gingival index, plaque index, and the retention 
index, developed by Loe and Silness in the early 1960's, f..- 


represented another approach to the evaluation of periodontal 





disease epidemiology. [Refs. 259-260] 
The three indexes actually comprise a system for am rere 


evaluating the clinical consequences of periodontal disease. 





{Ref. 261] oe 
The gingival index is entirely confined to the Sata, 
qualitative changes in the soft tissues of the gingivae. 
Each of four gingival areas of each tooth examined is 
assigned a numerical score, based upon clinical changes in 
the tissue, indicative of the degree of gingivitis present. 


The scores for the four areas are summed and divided by four 
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to obtain a gingival index for each tooth. The scores for 


each tooth are then summed and the total divided by the 





te. number of teeth examined to obtain a gingival index for the ae 
tae 
individual. [Ref. 261: pp. 610-613] aN 


The plaque index is confined to an evaluation of the 


amount of soft debris (plaque) which has accumulated on each wn 





of the four gingival areas previously evaluated for the 





gingival index. Each of the four gingival areas of each 
tooth examined is assigned a numerical score, based upon the 
amount of soft debris present. The plaque index is then 
calculated similarly to the gingival index. [Ref. 261: es 
: pp. 613-614] 


The retention index is based upon an evaluation of 





the degree of rough surfaces, such as caries, calculus, and 
@ ‘ : : , , 
i oe imperfect restorations, available for accumulation (retention) as 


of bacteria, which promote gingival disease, on each tooth 





previously evaluated for the gingival and plaque indexes. 
: A numerical score is established for each tooth and the final ee 
retention index is calculated similarly to the gingival and 
plaque indexes. [Ref. 261: p. 614} ee 
. 8. Calculus Surface Index 

The calculus surface index, developed by Ennerver, 
Sturzenberger, and Radike during the late 1950's, was an 
attempt to provide a scoring system for quantitating the 
g accumulation of dental calculus in short-term testing 


: programs. (Ref. 262] 
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Each of the mandibular incisors is considered on 
the basis of four surfaces, two proximals, one labial and 


one lingual. Upon examination, the number of tooth surfaces @ 
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on which calculus had occurred is noted, and a numerical 


re 
s 


ers 

P a 
a 
/ 


score, zero to four indicating the number of tooth surfaces 
involved, assigned. The totals for each tooth are summed. 
The calculus surface index is then the total number of tooth 
surfaces on which calculus had been detected. [Ref. 262: 
p. 54] 

9. Navy Periodontal Screening Examination 

The Navy periodontal screening examination was 
implemented in 1968 to increase dentists' awareness of 
periodontal pathology, emphasize the importance of early 
diagnosis and treatment, and provide a tool for assessing 
patients' abilities and motivation for practicing health 4. 
maintenance activities. [Refs. 263-268] | 

The Navy periodontal screening examination is com- 
prised of two separate indexes: the Navy periodontal disease 
index and the Navy plaque index. Both indexes are conducted 
on six teeth, the same teeth as used in Ramfjord's periodontal 
index. [Ref. 263: p. 41] 

The Navy periodontal disease index (NPDI) is comprised 
of two separate parts as well: a gingival score which assesses 
gingival inflammation, as manifest by color, consistency, den-~ 
sity, enlargement, and bleeding tendencies, and a periodontal 


pocket score which assesses alveolar bone destruction as 
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determined by periodontal pocket depth. Combining these 

two scores provides the NPDI score for the individual tooth. 

The results are recorded in the patient's clinical record as 

the NPDI score (the highest score obtained for any individual 
: tooth) and the NPDI total for the six teeth examined. ([Ref. 

264: p. 63] 


The Navy plaque index (NPI) reflects the plaque 





control status of the individual, emphasizing bacterial 

plaque present on the cervical area of the tooth, in contact 
with the gingival margins, felt to be of greatest concern in 
periodontal disease. The results are recorded in the patient's 
clinical record as the NPI score (the highest score obtained 
for any individual tooth) and the NPI total for the six teeth ae 


examined. [Ref. 264: p. 63] 208 


E. RECENT ADVANCES 
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These oral health indexes have been evaluated extensively 
in the literature. [Refs. 269-282] Many of the indexes, 
particularly those specific oral health indexes discussed 
above, have shown acceptance in specific and limited uses, 

e generally those for which the indexes were initially devel- 
oped. As with the general health status indexes, however, 
there has been no universal acceptance of the use or value 

e of the oral health indexes, particularly within the wide 


range of contexts of interest to clinicians, researchers, 


ana decision makers. 
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A major step in the search for a comprehensive oral 
health status measure was accomplished by Nikias, Sollecito, 
and Fink in the late 1970's. [Refs. 283-284] 

In evaluating the many oral health status indexes in 
use, they noted that none of the measures, when employed 
separately, produced a reasonably accurate picture of total 
Oral health. The need for one comprehensive index, capable 
of depicting all potentially significant disease processes, 
their interactions, and their consequences, was clearly 
stressed. They noted that, in addition to being able to 
summarize diverse clinical elements into one index, a com- 
prehensive oral health index should provide a meaningful 
concept of oral health status, expressed numerically, which 
would provide a statistical tool for use by clinicians, 
researchers, and decision makers alike, in a diverse range 
of situations. [Ref. 283: p. 148] 

Using data gathered from the examination of 1,290 adult 
members of the Health Insurance Plan of Greater New York 
(HIP) (a prepaid medical group practice), Nikias and her 
coworkers developed composite profiles of oral health status 
composed of specific clinical oral conditions. Eight clinical 


oral conditions were initially analyzed for inclusion ina 


comprehensive profile of oral health status: (1) edentulous- 
ness (in both arches, or in one arch); (2) number of missing 
and unreplaced teeth; (3) levels of disease in gingival and 


periodontal tissues; (4) percent of decayed teeth; (5) oral 
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hygiene status; (6) number of healthy and untreated teeth; 
(7) number of filled teeth; and (8) number of replaced teeth. 
[Ref. 283: p. 150] These were subsequently reduced to four 
dimensions, with four levels of clinical severity in each: 

(1) missing teeth; (2) disease in gingival and periodontal 
tissues; (3) decayed teeth; and (4) oral hygiene status. 
[Ref. 283: p. 152] 

The principal finding of this initial work was that it 
appeared feasible to combine multiple oral diseases and 
conditions to provide a comprehensive measure of oral health 
status. It was felt that this comprehensive measure, once 
developed, would facilitate epidemiological comparisons or 
oral health status among populations, assessment of changes 
in oral health status over time, evaluation and planning of 
Oral health programs, and meeting oral health needs of 
populations of interest. [Ref. 283: p. 158] 

After accomplishing the construction of comprehensive 
profiles of oral health status, Nikias and her coworkers 
took the next major step, that of attempting to combine the 
comprehensive profiles into one composite oral health index. 
The problem of just how to rank these comprehensive profiles 
in regard to relative oral health states was now addressed. 
The question to be answered, in considering only two patients 
for example, was that of, "which patient was in a better 
state of oral health, one which was missing several teeth but 


has no gingival or periodontal disease, or one who has all 
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teeth present but has significant gingival and periodontal 


disease?" Although a number of scaling procedures could ads or 
. eee a 
2 have been used, they decided upon attempting to use the \ ras 
- judgments of dental health professionals, combined with a oS 
= modified version of the equal appearing intervals method of a 
scaling, to provide relative rankings and subsequent develop- = 
= ment of a composite oral health index. [Ref. 284: p. 17] me 

Twenty-nine dentists, representing four broad categories - 

E ous 

of practitioners, were selected for participation in the neo, 


final ranking. Six of the dentists were from private 
practices, nine were from research-oriented situations, nine 


o. were from public health practice, and five of the dentists 





combined private practices with part-time teaching or research 
positions. [Ref. 284: p. 17] 
f~ Forty-two profiles, each composed of four clinical condi- hi ese noe 


tions: (1) number of missing and unreplaced teeth (divided 





'. 





pers 


ra re 


into four levels of severity); (2) periodontal disease 


S 


(divided into four levels of severity); (3) decayed teeth TF 
(divided into two levels of severity); and (4) oral hygiene 
(divided into two levels of severity). Each of the twenty- 
ae nine dentists was sent a package containing study background — 
information, a set of forty-two randomly ordered computer 
punch cards (each card contained a punched and printed = 
description of an oral health status profile), and detailed a 


a instructions on how to rank the profiles from best to worst ek 
< 
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using an integer scale from one to nine. The ranking by 
oral health status was accomplished by sorting the forty-two 
computer punch cards into nine piles, representing the nine 
levels of oral health indicated by the integer scale of one 
to nine. These piles were then subsequently ranked to pro- 
vide a relative ranking within each of the nine initial 
profiles. In the end, the forty~two computer punch cards, 
representing the forty-two clinical oral health profiles, 
would be ordered into a ranking such that each successive 
card or case would be in poorer oral health than the card 

or case preceding it. [Ref. 284: p. 17] The results of the 
individual dentist's rankings were then averaged and the 
means used to provide a "summary statistic" or "oral health 
index". (Ref. 284: pp. 17-18] 

In their conclusion, Nikias and her coworkers noted four 
major findings from their studies: (1) Developing a compre- 
hensive oral health index based upon professional concensus 
appears feasible. (2) Dentist's vary considerably in their 
assessment of clinical oral health states. This variation 
cannot simply be explained by professional orientations and 


activities, but seems to be subjective and varies according 


' to the individual. In fact, detailed analysis of the actual 


rankings of the oral health profiles revealed that there was 
as much or more variation within each professional group as 
between groups. The greatest variability is in oral health 


states that have a combination of contrasting levels of oral 
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disease and conditions. (3) Of the four conditions that 
made up the forty-two oral health profiles, number of missing poe 
and unreplaced teeth and levels of periodontal disease were 
found to be most highly correlated with the final ranking and 
oral health index. (4) Based upon work accomplished to present, 
it seems difficult to devise an all-purpose oral health index. 
[Ref. 284: pp. 21-25] 

The work of Nikias and her coworkers provided an impetus 
for new directions in research and development of oral health 
indexes. These new directions, largely represented by the 
subsequent work of Marcus and his coworkers [Refs. 285-293], 
related to the use of specific statistical methodologies, 
principally the preference pairs methodology of Mickey and 


Britt [Ref. 295], to derive oral health status indexes 


reflective of opinions and preferences of expert dental A was 


health professionals. It is this work which is examined 


in the following chapter. 
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III. ORAL HEALTH STATUS INDEX 


A major shift in the search for a comprehensive oral 
health status index occurred during the late 1970's. After 
conducting an exhaustive search for a comprehensive oral 
health index which would satisfy the requirements of clini- 
cians, researchers, decision makers, and other interested 
parties alike, Marcus and his coworkers felt that no such 
measure currently existed. Consequently, they embarked ona 
research program of several years duration in an attempt to 
develop such a comprehensive measure. [Refs. 285-293] 

The stated aims of this research were threefold. 

First, to develop comprehensive, integrated oral health 
status measures for both adult and pediatric populations, 
primarily for monitoring both groups to evaluate the outcome 
of oral health care services. [Ref. 285: p. 3] 

Second, to develop measures of oral health status 
characterizing populations rather than individuals; 
empirically derive significant factors in the concept of 
Oral health based upon opinions of experts (dentists) ; 
incorporate both positive factors associated with oral 
health and negative factors associated with oral pathology; 
establish quantifiable measures of oral health which permit 
statistical analysis of populations; ensure that any index 


developed is sensitive to changes in oral health status; 
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relevance for a wide range of potential users of the index, yest 


particularly dental practitioners, health care administrators, e 


ng) 


and the public. [Ref. 285: p. 3] 
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Third, to utilize a methodology which will ensure the 


7. 


reliability and validity of the measures used to develop the 
index. [Ref. 285: pp. 3-4] 

Marcus and his coworkers developed a set of 232 clinical 
cases for use in their research. Each case consisted of a 
brief patient description, including a brief medical and 
dental history; color slides of facial profiles and intraoral 
appearances; a set of radiographs, including periapicals, 


bitewings, and a panorex; a set of complete plaster mouth 





study casts; and a completed dental chart. [Ref. 287: p. 335] 
A panel of twelve general dentists was selected to provide 

the expert opinions needed during the experimentation and ou 

development phase of the research program. The consultants 

for the panel were selected upon the following four criteria: 

(1) a minimum of five years of clinical experience; (2) past 


or current experience in quality assessment and quality 





assurance activities; (3) representation from various 


geographic and demographic regions of the United States; 





and (4) clinical practice experience limited to general 
dentistry only. [Ref. 285: p. 30] 
The methodology selected for the statistical "scaling" 


was the paired preference procedure described by Mickey and a 
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Britt [Ref. 295] and available in the BMDP statistical 
package. [Refs. 296-297] 

The experiment was conducted by presenting the 232 
clinical cases, combined in 315 pairs of cases, to each 
of the twelve consultants. Each of the consultants selected 
which case of each pair of cases they considered to be in 
better oral health. Additionally, they were permitted to 
indicate significant differences in oral health, if they 
existed. The results of this experiment provided the judg- 
ments needed for the statistical computation portion of the 
paired preference methodology. [Ref. 291: p. 286] 

Marcus and his coworkers initially used twenty-four 
variables, which were later reduced to eighteen variables, 
in the paired preference program. These included variables 
for certain health factors (diabetes, cardiovascular disorders, 
and rheumatic fever); temporomandibular joint (TMJ) dysfunc- 
tions (sounds, dislocation, function loss, and pain); occlu- 
sion/crossbite; tipped/extruded teeth; tooth abrasion; 
fractured teeth; unerupted teeth; missing teeth; decayed 
teeth; filled teeth; restorations; endodontics, benign 
tumors (oral neoplasms such as fibromas, osteomas, tori, 
odontogenic cysts, and odontomas); replacements; calculus, 
mild periodontal disease (mild bone loss, periodontal 
pocket depth, and tooth mobility); moderate periodontal 
disease (moderate bone loss, periodontal pocket depth, and 
tooth mobility); and severe periodontal disease (marked bone 


loss, pocket depth, and tooth mobility). {Ref. 285: p. 27] 
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To determine the most advantageous combination of 


variables and “subvariables", Marcus and his coworkers ants 
performed “nearly 100" regressions on six of the oral health x. . 


variables deemed most significant after examination of 
initial results of the BMDP paired preference program: 

(1) mild periodontal disease; (2) moderate periodontal 
disease; (3) severe periodontal disease; (4) missing teeth; 
(5) decayed teeth; and (6) tumors. [Ref. 285: p. 73] 

Based upon the results of this initial attempt at index 
construction, the eight most promising variables obtained 
from the paired preference program were regressed against 
the judges' mean scores (from the initial BMDP paired 
preference programs using eighteen variables) in eleven 


different combinations of the variables, ranging from use 


of only four variables to use of all eight. The eight Chery 


variables used during this stage were: (1) mild periodontal 
disease; (2) moderate periodontal disease; (3) severe 
periodontal disease; (4) missing teeth; (5) decayed teeth; 
(6) tumors; (7) occlusion; and (8) replaced teeth. Upon 
examination of the results of these regressions, Marcus and 


his coworkers reached a "strong concensus" on a model using 
five of the variables: (1) moderate periodontal disease; 
(2) severe periodontal disease; (3) missing teeth; (4) 
decayed teeth; and (5) replaced teeth. [Ref. 285: p. 78] 


Marcus and his coworkers felt that the five variables 


chosen above were "not amenable to measurement on a large 
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scale", and required modification. This was particularly 
true of the periodontal disease variables, which had included 
measures of bone loss, periodontal pockets, and tooth mobility, 
and the missing teeth variable, which had included double 
counts of free ends, cuspids, and first molars. Further 
analysis revealed that adding the number of free ends to the 
total number of missing teeth (excluding third molars) and 
using only severe and pulpal decay (excluding mild decay), 
seemed to provide a better fit (higher R-squared values) to 
the mean case scores (derived from the initial BMDP paired 
preference program using eighteen variables). Additionally, 
a decision was made to use only the periodontal pocket depth 
as the measure of periodontal disease. Thus, the final five 
variables selected for the direct adult oral health index 
included: (1) moderate periodontal disease (moderate 
periodontal pocket depth); (2) severe periodontal disease 
(marked periodontal pocket depth); (3) missing teeth and free 
ends; (4) decayed teeth (severe and pulpal decay); and (5) 
replaced teeth. [Ref. 285: pp. 78-79] 

The scores were subsequently scaled so that the maximum 
score (best case of oral health) would be 100 and the minimum 
score (edentulous case) would be zero. [Ref. 291: p. 288] 

The final beta coefficients (weights) for the five 
variables for the index were as follows: (1) missing teeth 
and free ends: -3.31; (2) replaced teeth: +0.61; (3) decayed 
teeth: -1.79; (4) periodontal pocket depth (4-6 mm): -0.73; 


and (5) periodontal pocket depth (6+ mm): -3.02. [Ref. 292: p. 1] 
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To use the oral health status index, the patient is 
examined and the results are entered on the direct oral health 
status index adult examination form in Figure 1. Each tooth e... 
is marked as to whether it is missing (M), replaced (R), 
decayed (D), normal (N), or a space closure (C); the peri- 
odontal pockets are indicated at 4-6 mm and 6+ mm. The totals 
for each of the categories (missing, replaced, decayed, 4-6 mm 
pockets, and 6+ mm pockets) are placed in the # (total number) 
blank, multiplied by the appropriate beta coefficient (weight), 
the Hesubeine products subtracted from 100, and the result 
placed in the blank for the final index. [Ref. 292: p. 732] 

The direct oral health status index, once ascertained, 


provides a measure of the overall oral health status of the 


individual examined, and when combined with other representa- 


tives of a population of interest, provides an epidemiological £.. 


index useful in a wide range of health care activities, par- 
ticularly administration, planning, quality assessment, and 
research. 

The oral health status index developed by Marcus and his 
coworkers, of all the oral health indexes reviewed in the 
literature, appeared to provide the greatest potential for 
an oral health index within the health care system of the 
military services. As such, it provided the focal point for 
the majority of this current thesis effort contained within 


the following chapters. 
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OIRECT ORAL NEALTH STATUS INDEX 


ADULT EXAMINATION FORM 
foes PATIENT 1.0: ———______ DATE: ——_—________ 
( e BIRTH DATE: OXAMINER: 





LEGEND: R 
M2 missing ep 
R 2 repiaced A 
O 2 decayed yee 
: +4 N 2 norma oe 
: . C = space closure . 
: ‘ FE = free end Bee 
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Source: Marcus, Marvin; Gershen, Jay A.; Koch, Alma L.; 
and Snyder, Vera E. Oral Health Status Index User's Guide. a 
Los Angeles: University of California, 1980. oe 


Figure 1. Direct oral health status index adult 
examination form. 
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IV. ORAL HEALTH STATUS INDEX DVALUATION 


A. BACKGROUND 

After a thorough review of the literature -vailable on 
Oral health inusxes (see bibliography), the adult direct oral 
health status index developed by Marcus and his coworkers 


for 


[Refs. 285-294] seemed to possess the greatest potential 
the military health care system as an oral nealth status 
index. A number of questions concerning botn its development 
and use were raised, however, and provided the impetus for 
this thesis. 

There were two rimary objectives tor this thesis: Fir. , 
to verify the validity of the oral health status index throuth 


examination of its development and construction. and seconi, 


to subsequently utilize methodologies and procedures similar 


ran) 


to those used by Marcus and his coworkers, particularly «nos 
exploved be soch in her doctoral. Uissertalion: Sets 299.5% ars 


appiy them to military dentists and health scare beneticlarizs 


7] 


to verify the oral health status index's valiiizy for tne 


population served by the health benefit projvans of wns 


uniformed services, in particular ‘he hay. 


AS will pe notei .3s the thesis procuresses, Siyniticant 
problems were encountered during avaluation of tae or... Acaicth 


Status index. These problems made accompilshninjs she secon. 


we eit, cnn 


[hess objective tmp ristiicad. . Gonse7jaensiny, the Pea nade 
22 


























: rot) 
s of this thesis is largely devoted to verifying the validity oe 
~ e of the index's development and construction. Rene 
ae 
Sean B. THE FIRST STEPS Wee 

The researchers were able to spend several days at the wy 
University of California at Los Angeles (UCLA) dental school on 


with Dr. Marvin Marcus, the driving force behind the oral 


health status index. During this time, Dr. Marcus provided 





a great deal of personal insight into the development, a 


construction, and use of the oral health status index, as 





well as a wealth of information and data from his and his 
coworkers' initial work on the index. a 
Dr. Marcus provided copies of all publications and 


articles produced during, and subsequent to, development of 





ae the oral health status index. More important, however, he 
provided computer printouts containing the initial, un- 


transformed data (not otherwise available) dcrived from the 





Original 237 (only 232 were actually used by Dr. Marcus and 
his coworkers) clinical dental cases used in development of 


the oral health status index. 





Perhaps even more important, Dr. Marcus provided quintes- wets 
sential insight into the processes involved in development of 
the oral health status index, his own concerns about using the 
index as planned by these researchers, and his own ideas for 
future directions and research for oral health status indexes. 

Based upon the available data and literature, as well as 


oe Dr. Marcus's insightful guidance, an initial plan was developed aoe) 
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to accomplish the two principal objectives of this thesis Nhe 
research, noted above. 

Due to time and logistical constraints, a decision was 
made to use only 66 of the initial 237 clinical cases in 
subsequent research within the naval health care community. 
These cases had been used in follow-on research by Marcus 
and Schoen in ascertaining the relationship between oral 
health status and dentists' preferences for treatment 
palnning [Ref. 298], and were considered representative of 
the initial 232 clinical cases used in development of the 
oral health status index. Using the 66 selected clinical 
cases and the original, untransformed data used in development 
of the oral health status index, the results of further re- 
search within the naval health care environment could be 
compared, and the validity across populations evaluated. 

The 66 clinical cases provided by Dr. Marcus (see 
Appendix A) included a brief patient description, including 
medical and dental histories; color slides of facial profiles 
and intraoral appearances; a set of radiographs, including 
periapicals, bitewings, and a panorex; a set of complete 
plaster mouth study casts; and a completed dental chart. 

The variables of interest for all 66 clinical cases had 
been previously extracted by Dr. Marcus and his coworkers 
and were embedded within the computer printouts containing 
the original, untransformed data. This data was extracted 


from thecomputer printouts and written onto case abstraction 
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forms, Figure 2, for each of the 66 cases. This data, 
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with the following exception, was then entered into a working 


af, 
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x Ne. computer file for further analysis. The variables for the k.— 
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demographic and health variables were converted from the 


f 
ar) 


eal al a 
‘2 
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rv 


system used by Dr. Marcus and his co-workers to systems of 


"dummy" variables. Thus in the case of the race variable, 


A Be 
re rh 


rather than entering a 1 if American Indian, a 2 if Black, a 
3 if Oriental, etc., dummy variables (1 or 0) were used to 
indicate that an individual belongs (1) to that specific 
racial category, or does not (0). Because the data within 


these variables were primarily qualitative rather than quanti- 





x tative in nature, this methodology was considered more useful 


statistically. [Ref. 299: p. 111] ee 





The initial data set for each of the 66 cases (see 
ame Appendix B), derived from the original, untransformed data — 
provided by Dr. Marcus, yielded 208 variables, as indicated | 
in Figure 3. As can be seen, these included age; sex; race; 
history of diabetes, cardiovascular disease, or rheumatic 
fever; temporomandibular joint disease as manifest by sounds, 
dislocation, loss of function, or pain; occlusion, class I, 
II, or III; crossbite, anterior or posterior; gingivitis, 
acute or chronic; severely extruded teeth; severely abrated 
teeth; fractured teeth, mild, severe, or periapical; unerupted 
teeth; missing teeth, total, cuspids, first molars, free ends, 


or third molars; tipped teeth; virgin decay, mild, severe, or 


Tet evr res 


pulpal; recurrent decay, mild, severe, or pulpal; filled teeth, 
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CASE .BSTRACTION FORM 





Case No. Age Sex: Maie Fema.e foots 
Race: Americas indian (1° Heaith: Diavetes Sey 
Biack (2 Carciovascu.ar 
Oriente. 3. Rheumatic Fever 
Spanis: ta) 
white i5. 
Stner Specify: ‘6 
TMJ Declusion Crossctite Gingivitis 
Sounds Ciass i Anterior Acute 
Disiocation Ciass II Posterior Chronic 
Function Loss Cuass III 
Pain wo oe, 


Extruded 





(Fracture 
' 


‘Uneruprea i 
Missing otal® i , 











\Endodontics | 5erviceazic : 
1 wetective i : : 4 
‘Tumors : : iors 
jRepsaced “Fixed Fontics : i : Ea 
\ a AeMOvadse ' H 

(Cai cu_us : 

Bone Loss Mins j 











Source: Marc , Marvin; Gershen, Jay A.; anu och, Alma L. 
Development of Oral Health Status Measures for Quality 
Assurance. Final Report. Chicago: American Fund for Dental 


Health and the W.K. Kellogg Foundation, May 1980, p. 20. 


Figure 2. Clinical case abstraction form. 
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serviceable or defective; restorations, serviceable or 


defective; 


replaced teeth, fixed pontics or removable; 


calculus; bone loss, mild, moderate, or severe; periodontal 


pockets, 


class I, 


O-1.9 mm, 2-3.9 mm, 4-5.9 mm, or 6+ mm; and mobility, 


Additionally the latter of these, 


extruded teeth through mobility, 


are also characterized by 


position of occurrence within the mouth, maxillary (upper) 


or mandibular (lower) 


and anterior (front + posterior (back), 


as well as totals. 


It is these 66 


with their 208 variables, 


vide the starting point for further analysis and inv-stigaticn, 


primarily through the 8MDP pre:serence pairs program. 


[Refs. 296-297] 
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where the Beta-coefficients are derived from the judgments 





> (preferences) of experts, in this case dentists. [Ref. 296: 


co p. 547] 


: The dentists compare two clinical cases at a time, 









. evaluating whatever data and information is of value in that 


professional's particular methodology of clinical assessment, 






af and selects the case felt to be in better oral health. 






The input to the BMDP preference pairs program consists 






of a preference matrix and a data matrix. The preference 





matrix is composed of the paired cases and the preferences 






of the dentists (see Appendix L). The preference of each of 






the dentists is indicated as follows: If the first case of 





the pair is preferred over the second, the preference is 






noted as a "1", if the second case of the pair is preferred 









over the first, the preference is noted as a "-1". When no 





Lae eee preference is indicated, a zero is recorded (an option Marcus 






and his coworkers did not permit) [Ref. 285: p. 13]. The 






strength of the preference may also be indicated. For 









example, if the first case is preferred twice as much as the 





second, a "2" would be recorded; if the second case is pre~ 






ferred three times as much as the first, a "3" would be 





recorded. The data matrix is composed of the variables in 






the data base of each case. [Ref. 296: p. 547] 





For each pair of cases, Y, = (Xiye Xs or Xz cess Xi.) 





and e = (X Xan) a judgement vector (the 
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dentist's preference), Z = (X54 oe Xs Kage Xi 3 Xa P 






ieee Xin = Xan! is computed. A cross-product matrix is 
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subsequently formed, stepwise multiple regression is 


accomplished, an algorithm (model) is developed for each 


@ 
* 
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dentist, and scores are calculated for each clinical case. ata 


f, 


. , COTA ‘af sy 


[Ref. 296: p. 548] 
The Beta-coefficients determined for each of the varia- 


bles (Xs) provides the weights (clinical importance) of the 


t 
MP 


dentist's judgments (clinical assessments of oral health) 


rt 
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for those variables within the data base. [Ref. 296: p. 547] 
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D. A FIRST LOOK 


The original, untransformed data base (see Appendix B), 





containing 66 clinical cases with their respective 208 


variables, was processed through the BMDP preference pairs 


ou 
Pi en es ‘ 
Pan ee ae ee ee) 


program [Ref. 296: pp. 547-553]. The results of this analysis 


ae 


are provided in Appendix C. As can be seen from the data, the 


preference pairs program develops a separate model (algorithm) ae 


ae 
vate 


for each dentist. Additionally, the program was formatted so ered 


that a model was developed for the "average" dentist for 
subsequent use in constructing an oral health status index. 
The data in Table 1 is abstracted from Appendix C and 
provides the final step from the stepwise multiple regression‘ 
portion of the BMDP preference pairs program for each of the 
twelve dentists and the "average" dentist. As can be noted, 
no two dentists have exactly the same model. 
rs The number of variables ranges from 21, for the second 


dentist, to 23 for the "average" dentist, with 22 variables 





for all others. The variables involved differ from dentist's 
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-. . 
model to dentist's model. Additionally, even when the same Rae 
variables are involved, the Beta-coefficients (weights) and ‘x 
t-values differ significantly between individual dentists. 

As can be seen in Table 1, the R-squared values, showing moe 
the "goodness of fit" of the individual models, range from RO 
0.566 for the “average" dentist, to 1.000 for the third 
dentist. Based on the work of Nikias et al., this finding 
was not at all unexpected. In their work on developing an 
oral health status index based upon ranking of oral status 
profiles by panels of dental professionals, Nikias et al. 
found that dentists tended to develop very individual models 
of clinical assessment. The greatest variability in clinical 
assessment occurred between dentists when clinical cases 
contained a combination of contrasting levels of oral disease 
and conditions which brought them close to the same level of 
overall oral health. [Ref. 308: pp. 21-25] Thus in a situation 
where the clinical cases are intentionally paired so that 70% 
of them are very close in overall oral health, as they are in 
this situation [Ref. 285: p. 25], one would expect the R-squares 


for the individual dentists' models to be higher than that for 





the "average" dentist's model. 

Of principal importance is the "average" dentist's model, 
since this model provides the foundation for any oral health 
status index subsequently developed. As can be seen in Table ae 
1, the greatest t-values (B/SEB) are associated with the 


following variables: total severely fractured teeth (1.183); 
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total lower posterior missing teeth (0.541); upper 

‘posterior tipped teeth (0.420); lower anterior teeth with 
virgin decay (0.402); being female (0.105); and lower 
anterior replaced fixed pontics (0.101). Not only does the 
size of the model (the number of variables involved) make it 
impractical for use as an oral health index, the directions 
of some of the Beta-coefficients (weights) are intuitively 
bothersome in this model. For example, total severely frac- 
tured teeth is positively related to oral health (0.62540), as 
is upper posterior tipped teeth (0.01511). More will be said 
about this phenomenon later. 

Table 2 provides a correlation matrix revealing correlations 
between clinical case scores as computed through each indi- 
vidual dentist's model. As can be seen, the correlations 
range from -0.0598 (between dentists nine and eleven) to 0.6789 
(between dentists eight and twelve). 

The work of Nikias et al. had indicated that high correla- 
tions under these circumstances should not be expected. ([Ref. 
308: pp. 21-25] Marcus et al. in their work in developing an 
oral health status index, however, had reported very high 
correlations between judges' scores, ranging from 0.8156 to 
0.9623. (Ref. 285: pp. 41-42] 

Examination of dentists' preferences within specific case 
pairings, however, showed a wide range (see Appendix L). For 
example, for pairings of clinical cases four and six, the 


twelve dentists' preferences ranged from -2 to 2 (2, -1, 1, -2, 
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~2, 1, 1, 2, 1, 2, 1, and 2), as was true for clinical 
cases 43 and seven (1, -1, -1, -2, 1, 2, -1, 1, 1, 2, 2, and 
1), thirty and 36 (1, -1, -1, 2, -2, 1, 2, 1, 2, -2, -2, and th. 
~1), and forty and five (1, -l, -1, 2, 1, 1, -1, 2, 1, -2, -1, 
and 1). It should be noted that these represent the maximum 
range (-2 to 2) allowed by Marcus et al. when pairings of 
clinical cases were presented to the dentist consultants. 
[Ref. 285: p. 23] 
In fact, only 30.4 percent of the pairings of the 66 
clinical cases revealed the same direction for all twelve 
dentist's preferences (all preferred the first case (+) or 
all preferred the second case (-) of any pairing). And none 
of these pairings revealed the same degree of preference (all 


ones or all twos) for any one case over its alternative 


selection. 


E. CLUSTERING INTO FACTORS op 
The original, untransformed data base (see Appendix B), 

containing 66 clinical cases, with their respective 208 

variables, was processed through the BMDP factor analysis 

program [Ref. 302: pp. 480-499] in an attempt to reduce the 

number of variables under consideration through clustering 

the initial variables into "factors", composed of several 

variables, which seemed to provide the greatest explanatory 

power for the dentists' preferences. — 
Forty-nine factors, largely corresponding to the totals 


of each of the major variables (a sum of the positional 





variables) initially seemed to have the greatest explanatory 
power for the dentists' preferences. Six of these factors, 
however, were subsequently dropped. These factors related 
to bone loss (mild, moderate, and severe) and tooth mobility 
(class I, II, and III) variables). Bone loss is highly 
correlated with, and essentially measures the same clinical 
phenomenon as, periodontal pocket depth. (Refs. 303-306] Thus 
bone loss, as determined from radiographic measurements using 
the Schei scale [Ref. 303], was eliminated and periodontal 
pocket depth, as measured by use of a periodontal probe, was 
retained. Tooth mobility, like bone loss, is also highly 
correlated with periodontal pocket depth. Additionally, 
however, there are measurement problems with tooth mobility 
that make measurement of periodontal pocket depth more advan- 
tageous in assessing oral health status. [Ref. 307] Tooth 
mobility was thus eliminated in favor of periodontal pocket 
depth measurement. It should be noted that all three of these 
factors (bone loss, periodontal pocket depth, and tooth 
mobility) were included within the variables labeled periodon- 
tal disease (mild, moderate, and severe) in Marcus and his 
coworkers initial work. [Ref. 285: p. 27] They too, however, 
elected to eventually eliminate bone loss and tooth mobility 
from their final direct oral health index, retaining periodontal 
pocket depth as a measure of periodontal disease. [Ref. 285: 
pp. 78-79] 

A new, transformed data base was created (see Appendix D) 


containing 66 clinical cases with their new 43 factors 
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TABLE 3 


FORTY-THREE TRANSFORMED 


VARIABLES FROM SIXTY-SIX 


CLINICAL CASES. 
VARIABLE VARIABLE NAME 
x1* Case No. 
X2 TMJ Sounds 
x3 TMJ Dislocation 
x4 TMJ Function Loss 
x5 TMJ Pain 
x6 Occlusion, Class I 
x7 Occlusion, Class II 
X8 Occlusion, Class III 
X9 Crossbite, Anterior 
X10 Crossbite, Posterior 
X11 Gingivitis, Acure 
X12 Gingivitis, Chronic 
X13 Extruded, Severe, Total 
x14 Abrasion, Severe, Total 
‘5 Practure, Mild, Total 
X16 Fracture, Severe, Total 
X17 Fracture, Periapical, Total 
x18 Unerupted Teeth, Total 
x19 Missing Teeth, Total** 
X20 Missing Teeth, Cuspid/lst Molar, Total 
X21 Missing Teeth, Free Ends, Total 
X22 Missing Teeth, 3rd Molar, Total 
X23 Tipped Teeth, Total 
X24 virgin Decay, Mild, Total 
X25 Virgin Decay, Severe, Total 
X26 Virgin Decay, Pupal, Total 
X27 Recurrent Decay, Mild, Total 
X28 Recutrent Decay, Severe, Total 
X29 Recurrent Decay, Pupal, Total 
X30 Fillings, Serviceable, Total 
X31 Fillings, Defective, Total 
X32 Restorations, Serviceable, Total 
X33 Restorations. Defective, Total 
X34 Endodontics, Serviceable, Total 
%35 , Endodontics, Defective, Total 
X36 Tumors, Total 
X37 Replaced Teeth, Fixed Pontics, 
X38 Replaced Teeth, Removable, Total 
X39 Calculus, Total 
x40 Periodontal Pockets, 0-1.9mm, 
X41 Periodontal Pockets, 2-3.9mm, 
X42 Periodontal Pockets, 4-3.9mm, 
X43 Periodontal Pockets, 6+mm, Total 





*Case label only, 


not involved in regression. 


**Total does not include wisdom teeth. 
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(variables) (see Table 3). As can be seen in Table 3, the 
new 43 factors include variables for temporomandibular joint 
disease (sounds, dislocation, loss of function, and pain); 
occlusion (class I, II, and III); crossbite (anterior and 
posterior); gingivitis (acute and chronic); extruded teeth 
(severe); abrated teeth (severe); fractured teeth (mild, 
severe, and periapical); unerupted teeth; missing teeth 
(total, cuspids, first molars, free ends, and third molars) ; 
tipped teeth; virgin decay (mild, severe, and pulpal); 
recurrent decay (mild, severe, and pulpal); fillings (service- 
able and defective); restorations (serviceable and defective) ; 
endodontics (serviceable and defective); tumors; replaced 
teeth (fixed pontics and removable); calculus; and periodontal 


pockets (0-1.9 mm, 2-3.9 mm, 4-5.9 mm, and 6+ mm). 





This new, transformed data base (see Appendix D), contain- 


ing 66 clinical cases with their respective 43 variables, was 





processed through the BMDP preference pairs program [Ref. 296: 
pp. 547-553]. The results of this analysis are provided in w= 


Appendix E. As can be seen from the data, the preference 





pairs program again developed a separate model for each twee 
dentist as well as a model based upon the "average" dentist. | 
The data in Table 4 is abstracted from Appendix E and 
provides the final step from the stepwise multiple regression 
portion of the BMDP preference pairs program for each of the 
twelve dentists and the “average” dentist. Again, as with 


the earlier BMDP preference pairs program output with 208 
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variables, no two dentists have exactly the same model. There 
are 22 variables for each of the dentists' models and 23 varia- 
{ bles for the "average" dentist's model. As noted in the 
earlier model, the variables involved differ from dentist's 


model to dentist's model. Additionally, as seen before with 





208 variables, even when the variables are the same, the Beta- 


ae oe ee 
7 


coefficients (weights) and t~values for each of the dentists 





differ significantly. 

4 As can be seen in Table 4, the R-squared values of the 
individual models range from 0.566 for the "average" dentist 
to 1.000 for the third dentist. The earlier discussion con- 

: cerning R-squared values applies here as well. 


As before, the model developed for the "average" dentist 





is of pivotal importance in any subsequent development of an 
iz oral health status index. As can be seen in Table 4, the 
greatest t-values (B/SEB) are associated with the following 
variables: total severely extruded teeth (1.185); total 
| teeth with recurrent pulpal decay (0.735); caer ovenanaibalay 
joint pain (0.706); chronic gingivitis (0.663); total missing 


teeth, free ends (0.619); and total replaced teeth, fixed 





:: pontics (0.548). As in the earlier BMDP preference pairs 
program output using 208 variables, however, the size of the 
model (number of variables) make it impractical for use as an 

) oral health index and the directions of some of the Beta- 


coefficients (weights) in this model are again intuitively 





bothersome. For example, total severely extruded teeth is aoe 


ri ee ee On a 
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1S. 


positively related to oral health (0.22906), as is temporo- 
mandibular joint pain (0.41258). More will be said concerning 
this phenomenon later. 

Table 5 provides a correlation matrix revealing correla- 
tions between clinical case scores computed through each 
individual dentist's model. As can be seen, the correlations 
range from -0.2159 (between dentists three and twelve) to 
0.6030 (between dentists one and three). The earlier discus- 
sion concerning correlations between clinical case scores, in 
the BMDP preference pairs program using 208 variables, applies 


here as well. 


F. PARING DOWN 

The transformed data base (see Appendix D), containing 
66 clinical cases, with their respective 43 variables, was 
processed through the BMDP factor analysis program [Ref. 302: 
pp. 480-499] in a further attempt to reduce the number of 
variables under consideration, through further clustering of 
the previously transformed variables. 

Fourteen factors appeared to account for the majority of 
the explanatory power of these 43 variables, and are shown in 
Table 6. As can be seen, these variables include gingivitis 
(acute and chronic); extruded teeth (severe); fractured 
teeth; missing teeth (total and free ends), decayed teeth 
(virgin and recurrent); fillings and restorations; endodontics; 
replaced teeth; and periodontal pocket depth (0-3.9 mm, 4-5.9 


mm and 6+ mm). 
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TABLE 6 


FOURTEEN CLINICAL VARIABLES 


—_—_—_—_—_—_—_—_—_—_—_—————— — — 


Variable Variable Name 
X1* Case Number 
X2 Gingivitis, Acute 
X3 Gingivitis, Chronic 
X4 Extruded Teeth, Severe Total 
x5 Fractured Teeth, Total 
X6 Missing Teeth, Total** 
X7 Missing Teeth, Free Ends, Total 
x8 Decayed Teeth, Total 
x9 Filled and Restored Teeth, Total 
X10 Endodontics, Total 
X1ll Replaced Teeth, Total 
X12 Periodontal Pockets, 0-3.9 mm 
X13 Periodontal Pockets, 4-5.9 mm 
X14 Periodontal Pockets, 6+ mm 


*Case label only, not involved in regression. 


**Total does not include wisdom teeth. 


This newly transformed data set (see Appendix F), con- 
taining 66 clinical cases with their respective 14 variables, 
was processed through the BMDP preference pairs program [Ref: 
296: 547-553]. The results of this analysis are provided in 
Ropendix G. As can be seen from the data, the preference 
pairs program again developed a separate model for each 
dentist as wall as a model based upon the “average" dentist. 

The data in Table 7 is abstracted from Appendix G and 
provides the final step from the stepwise multiple regression 
portion of the BMDP preference pairs program for each of the 


twelve dentists as well as the “average” dentist. Again, as 
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with the earlier BMDP preference pairs programs with 208 and 


* 43 variables, no two dentists have exactly the same model. 


dentist's model, the Beta~coefficients (weights) and t-values 

oy of the variables within each of the dentist's models differ 
significantly. 

As can be seen in Table 7, the R-squared values of the 

individual models range from 0.399 for the second dentist, to 
0.850 for the fourth dentist. Unlike the earlier BMDP pref- 
erence pairs programs, for 208 and 43 variables, however, the 
model developed for the “average” dentist does not possess the 
lowest R-squared value, but is an intermediate value, 0.494. 

Me As with models seen previously, the model developed for 


the "average" dentist is of pivotal importance in any sub- 


be seen in Table 7, the greatest t-values (B/SEB) are associa- 
ted with the following variables: chronic gingivitis (4.047); 
acute gingivitis (3.323); total missing teeth (3.286); total 
decayed teeth, virgin and recurrent (3.175); total periodontal 
a pockets, 4-5.9 mm (2.745); total severely extruded teeth 
(2.452); total periodontal pockets, 0-3.9 mm (2.328); and 
total free ends (2.095). As with earlier BMDP preference 
pairs program outputs with 208 and 43 variables, however, the 
directions of some of the Beta-coefficients (weights) in this 


model are intuitively bothersome. For example, acute gingivitis 


By fn fa es 
Fae cer ie 


is positively related to oral health (1.18728), as are severely 


wr 


m extruded teeth (0.18096) and total fractured teeth (0.13272). 


Although the same variables are involved in each individual e... 


sequent development of an oral health status index. As can Ms, ss 
~ 


70 oe 




















mL 
So 






oie 
s, 




























Table 8 provides a correlation matrix revealing correla- 
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tions between clinical case scores computed through each 


individual dentist's model. As can be seen, the correlations 
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range from -0.2159 (between dentists three and twelve) to 
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0.603 (between dentists one and three). The earlier discus- 


Be 


sion, concerning correlations between clinical case scores 


h.-- 


in the BMDP preference pairs program using 208 and 43 variables, 


applies here as well. 


G. A WORKABLE MODEL? 

The newly transformed data base (see Appendix F), con- 
taining 66 clinical cases with their respective fourteen 
variables, was processed once again through the BMDP factor 
analysis program [Ref. 302: pp. 480-499], in a further 


attempt to reduce the number of variables under consideration, 





through additional clustering of the newly transformed 
variables. 

Seven factors appeared to account for the vast majority 
of the explanatory power of the fourteen variables, and are 
shown in Table 9. As can be seen, these variables included 


decayed teeth (including fractured teeth, virgin decay, 





recurrent decay, defective fillings, defective restorations, 
and defective endodontics); replaced teeth (fixed pontics hoa 
and removable); and periodontal pocket depths (2-3.9 mn, cs 
4-5.9 mm, and 6+ mm). 

- The newly transformed data base (see Appendix H), con- 


taining 66 clinical cases, with their respective seven variables, 
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TABLE 9 


SEVEN CLINICAL VARIABLES 





Variable 


X1* 
X2 
X3 
X4 
X5 
X6 
X7 


Variable Name 


Case Number 

Missing Teeth, Total ar 
Decayed Teeth, Total 
Replaced Teeth 
Periodontal Pockets, ° 
Periodontal Pockets, 
Periodontal Pockets, 


em 
*Case label only, not involved ir 
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was processed through the BMDP preference pairs program 


[Ref. 296: pp. 547-553]. The results of this analysis are 


i provided in Appendix I. As can be seen from the data, the ee 
© preference pairs program again developed a separate model 
fe for each dentist as well as a model based upon the “average” 

dentist. 


The data in Table 10 is abstracted from Appendix I and 






provides the final step from the stepwise multiple regression 


portions of the BMDP preference pairs program for each of the 






twelve dentists and the "average” dentist. Again, as with 






earlier BMDP preference pairs programs using 208, 43, and 14 






variables, no two dentists have exactly the same model. 





Although the same variables are involved within each individual 









dentist's model, the Beta-coefficients (weights) and t-values 






differ signficiantly. , an 


As can be seen in Table 10, the R-squared values of the 







individual dentists' models range from 0.339 for the fifth 





dentist, to 0.736 for the sixth dentist. The R-squared value 









of the “average" dentist's model is 0.427, and as in the last 






méddel, using fourteen variables, is not the lowest of the 






R-squared values. 





As in the models developed previously, using 208, 43, and 









14 variables, the model developed for the "average" dentist 








is of pivotal importance in subsequent development of an oral 








~ health status index. As can be seen in Table 10, the t-values, 











in descending order, for the seven variables were: total 
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missing teeth and free ends (7.000); total periodontal pocket 
depth, 6+ mm (5.948); total periodontal pocket depth, 4-5.9 
mm (4.775); total periodontal pocket depth 6+ mm (4.118); total 
replaced teeth (2.850); and total decayed teeth (1.032). 
Unlike earlier models developed by the BMDP preference pairs 
program with 208, 43, and 14 variables, all Beta-coefficients 
of the seven variables appear to be in appropriate directions. 
For example, total missing teeth and free ends are negatively 
related to oral health (-0.328), as are total decayed teeth 
(-0.01522), and total periodontal pocket depths, 2-3.9 mm 
(-0.19654), 4=5.9 mm (-0.23257), and 6+ mm (-0.34511); while 
total replaced teeth is positively related to oral health 
(0.13413). 

Table 11 provides a correlation matrix revealing correla- 
tions between clinical case scores computed through each 
individual dentist's model. As can be seen, the correlations 
range from 0.4838 (between dentists five and ten) to 0.9872 
(between dentists one and twelve). As can also be seen, these 
correlations differ significantly from those seen earlier with 


208, 43, and 14 variables. 


H. FROM MODEL TO INDEX 

The last BMDP preference pairs program model developed 
above, using seven variables, appeared to provide a reasonable 
basis for development of an index of oral health status. 
First, it was composed of a practical number of variables, 


seven. Second, it appeared clinically valid. That is, it 
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combined elements common to most of the oral health indexes 
developed in the past: decayed teeth, missing teeth, re- 
placed teeth, and periodontal pocket depths. Additionally, 
where there are differing levels of clinical severity, both 
the Beta-coefficients (weights) and t-values (statistical 
significance) show appropriate movement. For example, 
periodontal pocket depths of 2-3.9 mm have Beta-coefficients 
of -0.19654 and t-values of 4.118; periodontal pocket depths 
of 4-5.9 mm have Beta-coefficients of -0.23257 and t-values 
of 4.775; and periodontal pocket depths of 6+ mm have Beta- 
coefficients of -0.334511 and t-values of 5.948. Thus the 
model indicates not only increasing clinical weights associa- 
ted with increases in clinical severity, but reveals increasing 
statistical significance with increases in clinical severity 
as well. 

As can be noted in Appendix I, part of the output of the 
BMDP preference pairs program is a computation of scores based 
on judgments evaluated for each case", the clinical case 
scores based upon the individual and "average" dentist's 
assessments and preferences. The clinical case scores for 
the "average" dentists are those of primary interest in 
construction and development of an oral health status index. 
As can be noted in Appendix I, the 66 clinical case scores 
developed for the "average" dentist range from -3.36 (-3.35518) 
to -10.54 (-10.53981), with a mean of ~7.29 (-7.2880591) and 


a standard deviation of 1.5 (1.4996847). Of the 66 clinical 


81 


youn Y 
erste 


Ree 


ae ee 
aera ahs | 


Ra Ff el alt 
a oe ee ee 
wa A 


Key 





ae ee 


case scores, 96.97 percent (64/66) of the absolute values 
were less than 10.00. 

As in the work of Marcus et al., an oral health index with 
a maximum score of 100, indicating complete oral health, was 
desired primarily for aesthetic reasons. Concern that negative 
values might also be obtained was minimal, particularly con-~ 
sidering the differences between the population of interest 
within the uniformed services health benefits program and the 
population serviced by the UCLA dental school (to be discussed 
later). Consequently, the clinical case scores obtained from 
the BMDP preference pairs program (see Appendix I) were multi-~ 
plied by a constant value (ten), and the variables contained 
within the data base for the 66 clinical cases (see Appendix 
H) regressed against the products using the multiple regression 
methodology available through the Minitab system developed at 
Penn State. [Ref. 309: pp. 166-171] As can be seen in Table 
12, the equation's y-intercept was essentially zero (-0.0007935), 
and the order of the Beta-coefficients was preserved (as expec- 
ted when multiplying by a constant), with missing teeth and 
free-ends, decayed teeth, replaced teeth, periodontal pocket 
depths 2-3.9 mm, periodontal pocket depths 4-5.9 mm, and 
periodontal pocket depths 6+ mm, having Beta~coefficients of 
-3.8 (=3.279975891), -0.15 (-0.152220916), 1.34 (1.34132), 
~1.97 (-1.965415), -2.33 (-2.32565402), and ~3.45 (-3.45111465), 


respectively. 
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TABLE 12 


RESULTS OF MULTIPLE REGRESSION OF SEVEN VARIABLES 
AGAINST ORAL HEALTH STATUS INDEX SCORES OF 66 
CLINICAL CASES. 





Variable Variable Name B-Coefficient 
Intercept -0.0007935 

xl* Case Number 
X2 Missing Teeth and Free Ends -3.279975891 
X3 Decayed Teeth -0.152220916 
X4 Replaced Teeth 1.34132 
x5 Periodontal Pockets, 2-3.9 mm -1.965415 
X6 Periodontal Pockets, 4-5.9 mm -2.32565402 
X7 Periodontal Pockets, 6+ mm ~3.45111465 


*Case Label only, not involved in regression. 


To provide a numerical score for the oral health status 
index, the variables for each of the clinical cases are 
multiplied by their respective Beta-coefficients, summed, and 
the total subtracted from 100. The scores of the index of 
oral health for each of the 66 clinical cases are calculated 
and shown in Table 13. As can be seen, the final scores 
ranged from -5 (-5.398) to 66 (66.448), with a mean of 26 
(26.204), a median of 26 (26.949), and a standard deviation 
of 12 (12.443). 

To use this oral health status index on new clinical 
cases, similar procedures are employed. The number of missing 
teeth and free-ends; decayed teeth; replaced teeth; and 
periodontal pocket depths of 2-3.9 mm, 4-5.9 mm, and 6+ mm, 


are first ascertained through clinical examination. The 
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totals for each of these clinical categories are totaled, 


multiplied by their respective weights (Beta-coefficients), 


ses 
alate 


and the sums subtracted from 100 to yield the index score. oe. 
Eight-two individuals (active and retired military 
personnel) were examined at the Naval Postgraduate School 
(NPS) by Navy Dental Corps officers, the oral health status 
of each assessed, and oral health status index scores 
calculated. As can be seen in Table 14, the final scores 
ranged from 40 (40.247) to 100, with a mean of 91 (1.354), 
a median of 99 (99.391), and a standard deviation of 15 
(15.470). 
Welch's approximation for the t' statistic was computed 
using the statistics (mean, variance, and number of observa- 
tions) derived from the clinical case scores of the two 
populations (UCLA patient sample, 66 cases, and NPS patient 4 
sample, 82 cases) and, as might be expected from even a 
casual examination, the two populations are statistically 
distinct from one another (with a t' statistic of 28.388) at 
virtually any level of statistical significance. [Ref. 310: 
pp. 298-299} This fact may be a significant factor in the 
development, construction, and implementation of an oral - q 
health index for any population, a factor to be discussed 
later. 
The evaluation of Marcus and his coworkers' direct oral 


health status index has provided significant findings for 


subsequent research and development of oral health indexes, 


34 oe 











TABLE 13 


ORAL HEALTH STATUS INDEX SCORES FOR UCLA 











; te PATIENT SAMPLE OF 66 CLINICAL CASES. 
. Case No. Index Score Case No. Index Score 

1 30.95 34 31.58 
” 2 30.65 35 38.73 
Me 3 15.72 36 30.13 
. 4 29.13 37 26.29 
5 36.83 38 40.26 
6 20.90 39 8.40 
7 19.55 40 38.55 

8 29.00 4l -0.30 - 4 

9 36.66 42 26.94 oe 

10 32.87 43 24.02 de 

11 66.44 44 26.97 peta 

2 12 50.55 45 33.66 ; 

ns 13 37.21 46 36.05 
3 14 24.15 47 40.41 
15 32.70 48 30.97 
16 38.44 49 14.03 
17 34.64 50 25.86 
18 43.65 51 13.24 
19 27.21 52 24.13 
- o 20 -5.39 53 12.76 
hae, 21 7.76 54 25.68 
S oly 22 38.23 55 3.42 
P i 23 30.91 56 20.27 
‘. 24 27.32 57 9.93 
a 25 23.55 58 10.91 
‘ 26 32.56 59 7.13 
27 26.77 60 24.29 
28 34.34 61 26.40 
29 37.34 62 40.57 
30 34.20 63 16.06 
31 10.53 64 20.26 
32 26.38 65 13.99 
33 9.14 66 16.72 





Number of observations = 66 eee. 
Mean = 26.204 oe 
Median = 26.949 te 
Standard deviation = 12.443 canoes 











TABLE 14 





ORAL HEALTH STATUS INDEX SCORES FOR NPS 
PATIENT SAMPLE OF 82 CLINICAL CASES. 
— Case Index Case Index Case Index 
". No. Score No. Score No. Score 
1 63.89 29 99.39 57 100.00 
2 82.83 30 85.81 58 100.00 
3 96.72 31 86.72 59 100.00 
4 96.72 32 83.18 60 100.00 
5 93.44 33 99.39 1 100.00 
6 90.69 34 69.92 62 100.00 
7 40.24 35 96.26 63 100.00 
8 99.84 36 96.41 64 100.00 
9 99.84 37 96.41 65 100.00 
10 83.01 38 93.44 66 100.00 
ll 77.38 39 22.90 67 100.00 
ae 12 79.01 40 72.84 68 100.90 
* 13 75.51 41 99.39 69 100.00 
14 99.84 42 98.93 70 100.00 
15 93.28 43 63.63 71 100.00 
16 91.98 44 91.34 72 100.00 
17 99.54 45 98.93 73 100.00 
18 96.56 46 99.54 74 100.00 
19 93.34 47 99.93 75 100.00 
20 96.56 48 100.00 76 100.00 
21 79.82 49 100.00 77 100.00 
a 22 88.48 50 100.00 78 100.00 
“0 23 75.75 51 100.00 79 100.00 
a 24 97.90 52 100.00 80 100.00 
25 66.88 53 100.00 81 100.00 
26 70.95 54 100.00 82 100.00 
a0 27 78.18 55 100.00 
e 28 28.30 56 100.00 


nt Number of abservations = 82 
ae Mean = 91.354 

Median = 99.391 

Standard deviation = 15.470 


particularly within the military health services sector. 


oe These findings are addressed within the following chapter. 








V. FINDINGS AND CONCLUSIONS 


A. ORAL HEALTH STATUS INDEX 

The oral health status index, as developed by Marcus et 
al. [Refs. 285-293], and currently configured, appears inade- 
quate for use as a Navy oral health status index for a number 
of reasons. 

1. Sampling Problems 

When evaluating the applicability of the oral health 
status index for assessing the oral health status of military 
personnel, a significant problem arises as a result of the 
sample population selected for its development. 

The population, from which the patient sample was 
drawn, was composed of patients examined and treated at the 
Veterans Administration Hospital, Los Angeles; Public Health 
Service Hospital, Los Angeles; and University of California 
at Los Angeles Dental School. 

This patient sample is significantly different from 
that encountered within the patient population served by the 
Navy, as can be seen by examining the data presented within 
Tables 13 and 14. As noted previously, the two populations 
are statistically distinct from one another, as determined 
by Welch's approximation for the t' statistic, at virtually 
any level of statistical significance (t' statistic of 28.388). 


[Ref. 310: pp. 298-299] 
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The fact that dental health professionals apparently 
use different factors (variables) in assessing the oral health 
status of different populations was pointed out by Marcus et 
al. and Koch et al. during development of the direct adult oral 
health status index and the children's oral health status 
index, respectively. [Ref. 285-293] 

As can be seen by examination of the direct oral 
health status index adult examination form in Figure 4, and 
the children's oral health status index examination form in 


Figure 5, the variables comprising each index, as well as 





their clinical importance (Beta~coefficients (8) or weights), 





are different. The direct adult oral health status index 


considers missing teeth (8 = -3.13), free ends (8 = -3.13), 





replaced teeth (8 = +0.61), decayed teeth (8 = -1.79), 





periodontal pockets 4-6 mm (8 = -0.73), and periodontal 
pockets 6+ mm (8 = -3.02). [{Ref. 292: p. 729] The children's 
oral health status index, however, considers missing teeth, 
anterior primary (8 = -2.27), posterior primary (8 = -4.55), 


and all secondary (8 = ~4.55); decayed teeth, anterior 





primary (8 = -1.22), posterior primary (8 = -2.24), and all 





secondary (8 = -.2.24); occlusion (8 = -4.38); and abnormal 


position (8 = -1.73). [Ref. 293: p. 39] 





In a situation where the population of interest is 
significantly different from that for which the index was 
developed, as it is in this case, the applicability of the 


index must be considered questionable. 
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Figure 4. 





Direct oral health status index adult 
examination 





DIRECT ORAL HEALTH STATUS INDEX 
AOULT EXAMINATION FORM 
OATE: 


EXAMINER: 





LEGENO: 

M = missing 

R 2 replaced 

O = decayed 

N = normal 

C = space closure 
FE = free end 
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. CHILDREN'S ORAL HEALTH STATUS INDEX 
ey” EXAMINATION FORM 
4," 
v 
PATIENT 1.9. —__._____ DATE: 


BIRTH DATE: EXAMINER 1.0. 


he OCCLUSION: 
ze CROSSBITE = 1° ANT. ____ 1° POST. 2° ANT. ___ 2° POST. ___ NONE) 
NAO NORMAL (-1 to4emmiG TOTAL 


NAO NORMAL (1~4mm) CO OCCLUSAL CHECKS ___. 








vae OVERGITE » EXCESS ( >4mm) —___. OPEN (¢ -1) 
Lory Ovenver = EXCESS ( >4mm) ABSENT (< 1mm) 
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Figure 5. Children's oral health status index 
examination form. 
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i. 2. Statistical Problems mete 
r. rates 
» en There appear to be a number of problems, primarily pea 


k te related to the use of statistical procedures and manipulations, 

3 involved in the oral health status index's development, con- 

; struction, and application, that render the validity of the 
index questionable. 

a First, although the stated purpose for the development 

and construction of the oral health status index was to identi- 

fy "the decision factors that correspond, in a statistical 

sense, to the quantitative framework of the dentists’ judgments," 

Marcus and his coworkers introduced potential bias by assigning 

clinical "severity weights" to all variables (See Figure 6). 

These clinical severity weights were not made availa- 

i ble to the dentists performing the paired preference experiment 
1f.. but were used to transform the raw data within each clinical 
case prior to use in the BMDP preference pairs statistical 
software program. [Ref. 285: pp. 28-29] 

The resulting Beta-coefficients (clinical weights), 
consequently, reflected not only the interactions between the 
dentists' preferences and the variables involved in each of 
the cases, but a systematic bias introduced by transforming 
: the raw variables through multiplication by the assiqned 

clinical severity weights. 
Second, although the final adult oral health index 


uses only the total number of teeth for each of the clinical 


s categories (variables), during the development and construction 
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CASE ABSTRACTION FORM 


Case No. Age Sex: Male Female 





Race: American Indian (1) Health: Diabetes 3 
Black (2) Cardiovascular 9105 
Oriental (3) Rheumatic Fever_ 
Spanish (4) 

Whice (5) 

Other (Specify) (6) ¢ ) 
TMJ Occlusion Crossbite Gingivitis 
Sounds 1 Class I 1 Anterior _3 Acute 0. 


Dislocation 1,5 Class II 3 Posterior_ } Chronic_0 
Function Loss 5 Class III_ 3 
Pain 2 


ee ee ee 
[Total® dn dd 
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Clinical severity weights as assigned by 
Marcus et al. during development of the 


oral health status index. 
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of the index, "most of the adult variables were transformed 
from absolute numbers to percentages for inclusion into the 
paired preference program." [Ref. 285: p. 28] 

Beta-coefficients (clinical weights) of index variables 
were generally derived from the use of three different deter- 
minants: (1) the number of teeth within each clinical category, 
divided by the total number of teeth present in the patient's 
mouth, and expressed as a percentage; (2) the variables' 
respective clinical "severity weights", and (3) the preferences 
of the dentist consultants. 

The use of the resultant Beta-coefficients within the 
final adult oral health index, however, is predicated on only 
the total number of teeth within each of the clinical categories. 
Neither the percentages of teeth present nor assigned “severity 
weights" are involved in calculation of the index. 

The problem in terms of the index's validity, lies in 
the fact that the index is being used to measure some factor 
other than that for which it was developed. 

Third, the clinical case scores, against which all 
subsequent multiple regressions were performed in developing 
the oral health status index, were obtained by processing the 
clinical cases containing 18 variables through the BMDP pref- 
erence pairs program. (Ref. 289: p. 77] Subsequent multiple 
regressions performed in attempting to develop a model for the 
oral health status index, regardless of which of the ciinical 


variables were involved, or the number of clinical variables 
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», ow) 
“ st) 
is ae 
a used, all had one fact in common. All equations were oe 
aa a“ oe) 
oa . Cae i “) 
. regressed against the same clinical case scores, those oat , 

obtained during the original regressions of the equation ®... at 
oH containing 18 variables. Thus, the clinical scores used “on 
me in all subsequent regressions in the development of the Doe 

model for the oral health status index were not a function oe 


of the variables in the equation being regressed, which 
would have made the equations internally valid, but were ow 
a function of a different regression equation, one composed 
of 18 variables. 
Fourth, the choice of variables to be included 
within the final oral health index was based on somewhat mate 
a arbitrary selection by Marcus and his coworkers rather than 
on purely statistical evidence. For example, the five Sie 


“te variables selected for inclusion within the final index pena Reet 





z were not those variables with the greatest statistical 
significance, as suggested by t-values, but were the result a 
of the researchers reaching a "strong consensus" on which 
variables should have been included within the final index. 
[Ref. 285: p. 78] 

Fifth, there were a number of statistical manipula- 
tions performed, considered by Marcus and his coworkers to 
be "extremely informative", which appeared to be of ques- 
tionable value. 7s 

For example, each of the total variables (the sum of ae 


Ls the four positional variables) “was regressed on its locational fre 
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subcomponents (the four positional variables) ... in order 
to find more expedient ways to capture the quantitative 
information held in the whole variable." Recalling that 
the total variable of each clinical category was merely the 
sum of its positional components multiplied by arbitrarily 
assigned clinical severity weights, the value of such a 
regression in determining which variables should have been 
retained and which should have been discarded was questionable. 
This was particularly true when emphasis was put on statistics 
such as Beta~coefficients, t-values, and R-square values, 
resulting from such statistical procedures. 

There were enough of these problems in the development 
and construction of the oral heaith status index that the 
statistical validity of the index should have been considered 


questionable. 


B. PROBLEMS ENCOUNTERED IN DEVELOPMENT OF A MODEL 

The work described in the previous chapter was accomplished 
primarily to resolve a number of the problems inherent in 
Marcus and his coworkers' oral health status index described 
above. A number of findings of interest resulted from this 


exercise, 


1. Sampling Problems 


Since the same clinical cases and initial data base 
were used, the sampling problems described above will continue 
until an applicable population is sampled and a new data base 


created. 
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2. The BMDP Preference Pairs Program : 
The BMDP preference pairs program [Ref. 300-301] 


appears to be a powerful statistical software program. As 
a precautionary note, however, what it does, and how it is 
accomplished, need to be understood by those using it. 

Initial outputs of BMDP preference pairs programs 
were at times confusing. As early runs were reviewed, 
particularly those runs with less than 43 variables, it was 
noted that the program had predicted zero scores for every 
clinical ane for some dentists, with subsequent zero 
correlations between those dentists and all other dentists, 
including themselves. 

Further examination of the output printouts, however, 
revealed several consistent findings in these situations. 

First, the model developed for each dentist (producing 
zero scores and correlations) through the multiple regression 
phase of the preference pairs program consistently had only 
one variable. Although the variable could be any of the 
possibilities for that particular set (208, 43, 14, or 7 
variables), there was only one variable in the final step 
(always the first step). 

Second, for every case within the data base, scores 
based on those particular dentists’ judgments were always 
zero. 

Third, correlations between case scores were always 
zero for any clinical case which involved that particular 


dentist. 
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Cases were also found, however, that revealed the 
first finding (only one variable), but failed to produce the 
problems encountered within the second and third findings 
(zero scores and zero correlations between scores, respectively). 

Subsequent experience with the BMDP preference pairs 
program revealed that this particular problem could be alle- 
viated by changing the t-values used within the multiple 
regression phase of the program. Default t-values for the 
program were 2.0 (TENTER = 2.0, TREMOVE = 2.0) [Ref. 300: 

p. 553] but were capable of being altered as desired. 

Subsequent runs of the program included t-values of 
2.0, 1.0, and 0.0 (TENTER = 2.0, 1.0, and 0.0; TREMOVE = 2.0, 
1.0, and 0.0) and provided more interesting results. Since 
the final model, containing seven variables, was of primary 
interest in development of the index, all three runs of the 
preference pairs program (TENTER~, TREMOVE-values 0.0, 1.0, 
and 2.0) were provided in Appendices I, J, and K, respectively. 

The effects of alt:ring the t-values (TENTER, TREMOVE) 
within the BMDP preference pairs program can be seen by 
examining Appendices I, J, and K. As can be seen, multiple 
effects resulted. 

As the t-values (TENTER, TREMOVE) were increased from 
0.0 to 2.0, the number of steps, and consequently the number 
of variables, within the multiple regression portion of the 
program generally decreased. 

On the other hand, as the t-values (TENTER, TREMOVE) 


were increased from 0.0 to 2.0, the R-squared values generally, 


97 











OP EPL ES 


but not always, decreased. Of particular interest, the two 
dentists (judges 2 and 5) for whom the preference pairs 
program yielded zero correlations when the t-values (TENTER, 
TREMOVE) were 2.0, revealed decreased R-squared values when 
the t-values (TENTER, TREMOVE) were increased from 0.0 to 1.0, 
but increased R-squared values when the t-values (TENTER, 
TREMOVE) wre increased from 1.0 to 2.0. 

At a Minimum, these findings should encourage at least 
some caution in interpreting and comparing findings from 
different regression models, or even the same regression 
model under different levels of significance, evaluated 
through the BMDP preference pairs program. As noted above, 
this should be particularly true of t-values (B/SEB), R-squared 


values, and correlations of dentists' case scores. 


C. DEVELOPMENT OF THE MODEL 

The initial 208 variables, as originally abstracted from 
the clinical cases, were obviously too cumbersome to provide 
a functional oral health index. Factor analysis, as described 
in the previous chapter, provided a means of grouping certain 
of these variables into factors (groups of variables) which 
seemed to provide the greatest explanatory power for the 
dentists' preferences. This procedure was utilized successive- 
ly for reductions from 208 variables, to 43 variables (factors), 
to 14 variables (factors) and to seven variables (factors). 

The results of the factor analyses seemed to be rational 


from a clinical diagnostic point of view as well as froma 
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statistical point of view. For example, the initial factor 
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analysis procedure (on 208 variables) revealed that the 
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greatest explanation for the dentists' preference could be 














~ obtained by using only the total number (the sum of the 

n 

‘ positional variables) of teeth involved within each clinical 

; variable, a fact that seemed to make clinical sense, particu- 

: larly when one viewed the somewhat confusing Beta-coefficients 

for the positional variables obtained earlier (with 208 

. variables) from the BMDP preference pairs program. Keen 
-. Additionally, as the number of variables (factors) were “ 

: further reduced to 43, 14, and finally seven variables ee 
i (factors), the groupings continued to be rational froma nsnxf 
y clinical diagnostic point of view as well as a statistical Sa 
b~ point of view. For example, the decay variable ultimately Raa 
; sa came to include the totals of fractured teeth (mild, severe, eae 

— and periapical), virgin decay (mild, severe, and pulpal), 

- recurrent decay (mild, severe, and pulpal), defective fillings, 

of defective restorations, and defective endodontics, combinations 

2 which seemed to be appropriate clinically. This was true for 

= all of the seven variables (factors) within the final model. 

: Moreover, other statistics of interest revealed expected 

: movement as the number of variables (factors) were reduced 

Be from 208, through 43 and 14, to seven. First, the t-values 

’ (B/SEB) of each of the variables (factors) increased as the eee 
: number of variables decreased. Second, the R-squared values : 

s decreased concomitantly with the decrease in the number of oe 
peo, < aes eo 
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oe ee oe ota 
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independent variables within each regression model. 
[Ref. 299: p. 78] 

Lastly, the Beta-coefficients of all seven variables 
(factors) in the final model seemed intuitively and clinically 
appropriate. The Beta-coefficients of all variables were 
appropriate in direction in regard to oral health status, 
with missing teeth, decayed teeth, and abnormal periodontal 
pocket depths (0-3.9 mm, 4-5.9 mm, and 6+ mm) negatively 
related to oral health, and replaced teeth positively related 


to oral health. 


D. DEVELOPMENT OF THE INDEX 

As noted in the previous chapter, the final model developed, 
with its seven variables (factors), provided the basis for the 
Oral health status index. This oral health status index, with 
its variables and Beta-coefficients, was provided within Table 
12. 

Interestingly enough, with one exception, the variables 
included within the oral health status index were the same 
as those selected by Marcus et al. As can be seen by examining 
the data within Table 15, which compares the final oral health 
status index developed by Marcus and his coworkers with that 
developed within this thesis, with the single exception of 
periodontal pockets, 2-3.9 mm, the variables included are the 
same. The Beta-coefficients of these variables, however, differ 


significantly. 
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Sty TABLE 15 
{eo 
: = COMPARISON OF ORAL HEALTH STATUS INDEXES 
" DEVELOPED BY MARCUS ET AL. AND WITHIN 
w THIS THESIS. 
sari 
Beta-Coefficients 
is Variable Name Marcus et al. Thesis 
MG Missing Teeth and 
a Free Ends -3.13 -3.28 
Decayed Teeth -1.79 -0.15 
Replaced Teeth +0.61 41.34 
Periodontal Pockets, cour® 
2-3.9 mm*® ee -1.97 feat 
Periodontal Pockets, oe te 
4-5.9 mm -0.73 -2.33 ee, 
Periodontal Pockets, Pe ee 
6+ mm -3.02 -3.45 er bets 


‘N 
*Not included in the oral health status Index of Marcus et al. 
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With the obvious differences, as noted within the 


previous Chapter, in the use of statistical procedures by 2 
i rg 


Marcus and his coworkers and as used within this thesis, a 
this finding was not unexpected. Neither was it easily 
explained, however. The differences were manifold and 


comparisons may be of limited value. 


E. SUMMARY OF CONCLUSIONS 

First, the oral health status index, as developed by 
Marcus and his coworkers should not be applied to the general 
population served by the health benefits program of the 
uniformed services. 

Second, the BMDP preference pairs program is a powerful 
statistical tool. If used thoughtfully, this program is 
capable of developing a mathematical model, revealing the 
importance (statistical weight) attributed to each diagnostic ate 
variable within the model, as pairs of clinical cases are 
assessed to determine their relative levels of oral health. 

Third, using the output of the BMDP preference pairs 
program, and a carefully selected population sample, it is 
possible to develop an oral health status index that is 
valid and meaningful for the general population served by 
the health benefits program of the uniformed services. 

Fourth, an oral health index, developed for use within 
the uniformed services, can be a powerful tool in evaluating 
unmet needs of eligible benficiaries; assessing the quality 


of care provided to beneficiaries; determining the effectiveness, 
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efficiency, and productivity of providers in providing care 


to beneficiaries; determining optimal allocation of limited 





| Co. health care resources; and in accomplishing a wide range of = 

health care planning activities, including manpower, resource, mt 
and budgetary. Cred 
l There remains, however, essential work to be done. With oe, 


this in mind, recommendations for future endeavors in 
developing an oral health status index are addressed within 


i the following chapter. 
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VI. RECOMMENDATIONS ae 
ae 


A. CONTINUE DEVELOPMENT OF ORAL HEALTH INDEX 

Further work on development of an oral health index, 
applicable to the health benefits program of the uniformed 
services, should be continued. In particular, populations 
of health care providers, managers, planners, and other 
decision makers, as well as patients, which reflect the 
constituency of the health benefits program supported by 
the Navy need to be sampled adequately to provide a basis 
for subsequent research and development of an oral health 


index. 


B. EXPAND THE SCOPE OF THE ORAL HEALTH INDEX 


The development of the oral health index should be See 


expanded in scope, to include not only the emphasis and 
priorities of clinical dentists, but to include the priorities 
and concerns of health care managers, planners, and other 
decision makers as well. 

To be successful in evaluating health care system concerns 
such as effectiveness, efficiency, and productivity, an oral 
health index must reflect the values of all significant health 
care professionals within the health care system, including 


health care providers, managers, planners, and other decision 


makers. 
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For example, the assessment of oral health and treatment 
needs by health care providers may be a function of the 
clinical status of oral tissues and structures, general 
physical health, presence of specific pathologic entities, 
prognosis, age, sex, race, social status, etc., of the patient. 
The assessment of oral health and treatment needs by managers, 
planners, and other decision makers, however, may also involve 
such factors as the level of needs within the population of 
interest, the cost of various treatment alternatives, the 
resources available to cope with such alternatives, current 


laws and regulations pertaining to the provision of care, etc. 


C. EVALUATE METHODOLOGIES USED IN DEVELOPMENT OF INDEXES 

A number of basic concerns regarding methodologies 
employed in the development of oral health indexes need to 
be resolved. 

The manner in which clinical data ani .nformation are 
presented to health care experts needs *o be evaluated 
further. There are a number of experimental. effects that 
May occur as a result of the experime:.*41 vetnodoiogy itseir, 
and where these occur, they need to ve csentitilel. ~~ rew 
of the major questions to be addresses inciude the following: 

What are the effects of providing photouraphs anc histori- 
cal data of patients, from which the sex, race, age, and other 


social and demographic characteristics may be ascertained, on 


the assessment of oral health. 
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Do health care providers, managers, planners, and 
decision makers give greater importance to certain clinical 
conditions when they are found within some demographic groups 
than when they are found in others? 

Are certain clinical oral conditions given greater 
significance when they occur within certain occupational 
groups, such as aviators or divers, than when they occur 
within the general population? 

Are, or should, different beneficiary groups, such as 
active military, retired military, or dependent personnel, be 
evaluated differently in regard to oral health and significance 


of oral pathology than are other categories of beneficiaries? 


D. EVALUATE DECISION MODELS OF HEALTH CARE PROFESSIONALS 

Additional research needs to be accomplished to more 
fully understand the decision making models used by health 
care providers, managers, planners, and decision makers. 

Do dental care providers, for example, base severity of 
decay on the total number of teeth affected with carious 
lesions, the ratio of decayed teeth to the total number of 
teeth present within a patient's mouth, the location of the 
decayed teeth within the patient's mouth, or some other 
model of clinical assessment. 

How do health care providers, managers, planners, and 
decision makers measure effectiveness, efficiency, and 
productivity within the health care system? What are the 


variables of importance? The chance in the overall health 
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of the individual; the change in the overall health status 
of a beneficary population; the number of patients treated; 
the number of procedures accomplished; the resources utilized; 


or some other factor or group of factors? 


E. EVALUATE ALTERNATIVE METHODOLOGIES 

Alternative methodologies, such as expert systems should 
be evaluated for their applicability in developing models of 
the decision making processes of health care providers, 


Managers, planners, and other decision makers. 
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SCORES BASED ON JUDGHENTS EVALUATED FOR EACH CASE. 
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